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Abstract 



We study a model of species survival recently proposed by Michael and Volkov. 
We interpret it as a variant of empirical processes, in which the sample size is random 
and when decreasing, samples of smallest numerical values are removed. Micheal and 
Volkov proved that the empirical distributions converge to the sample distribution 
conditioned not to be below a certain threshold. We prove a functional central limit 
theorem for the fluctuations. There exists a threshold above which the limit process is 
Gaussian with variance bounded below by a positive constant, while at the threshold 
it is half-Gaussian. 

1 Introduction and Statement of Results 

We study a generalization of the Guiol Machado Schinazi (GMS) model |GMS11] [BAMRll] 
|GMSj that was recently proposed and analyzed by Michael and Volkov [MVllj . 

The model could be viewed as describing an ecosystem whose population size is given 
by a simple Markov chain on Z_|_. Each member of the ecosystem has a random "fitness" 
assigned at birth. When the population size decreases, the "least fit" members are elim- 
inated. The population size process is driven by an IID sequence of Z-valued random 
variables, {In : n E N). Starting with population size equal to at time n = 0, at each 
time n G N, the population increases by In if In ^ 0, or decreases by the minimum between 
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the present population size and if /„ < 0. In the original GMS model, In G {—1, 1}, 
that is the population size is modeled by a birth and death chain. 

When In = 1 for all n, the ecosystem at time n consists of n IID samples from a U[0, 1] 
distribution, hence the immediate connection to empirical processes. In this model there 
are two additional ingredients. The first is the randomness of the sample size. This is not 
new, e.g. Pyke |Pyk68| and also, in a closely related context, Asmussen |Asm82j . The 
former paper studies empirical processes in which the sample size is random and obeys 
a law of large numbers with positive speed. In the latter, among other things, the au- 
thor proves a scaling limit for empirical distributions corresponding to sample size given 
by an increasing sequence of stopping times which are infinite with positive probability, 
conditioned to be finite. The second ingredient of the present model, and which appears 
to be new, is the mechanism according to which samples are discarded when the sample 
size decreases. This mechanism is responsible for criticality : The empirical distribution 
converges to the sample distribution conditioned not to drop below a certain threshold, 
in contrast to the classical Glivenko-Cantelli theorem, where the empirical distributions 
converge to the sample distribution. A result of the same spirit holds in [Asm82j . due the 
conditioning. Furthermore, as we will show below, fluctuations from this distribution scale 
to a process which is discontinuous at the critical threshold. The process is Gaussian except 
at the critical threshold, where it is half- normal (the absolute value of a centered normal). 
This deviates from the "classical" Brownian Bridge scaling for empirical processes (e.g. 
|Bil99l Theorem 14.3]), which is also the scaling limit in |Pyk68| and [Asm82j . 

We turn to a formal description of the model. Let /, /i,... be an IID sequence of 
Z-valued random variables. We define the population size process X by letting 

Xq := 0, Xn+i := Xn + max(/„+i, -X„), n G Z+. 

This inductive formula gives the waiting time of the n+ 1-th customer in a G/G/1 queue, 
with In+i interpreted as the difference between the service time of n-th customer and in- 
terarrival time between n-th and n + 1-th customer. However the main object of interest in 
the present model is the additional and intrinsic fitness structure, which does not translate 
naturally into queuing theory. 

For / G [0, 1] and n G let Ln{f) denote the number of members of the population 
at time n whose fitness does not exceed /, and write L{f) := {Ln{f) '■ n G Z+) for the cor- 
responding process. Here is an explicit construction. For n G Z+, let Sn,+ '■= X]o<j<n(-(?)+ 
and similarly, Sn- '■= So<i<n (-(?)-' where we here and henceforth we convene that 
summation over an empty index set has sum 0, and for a real number x, we define 
x+ := max(x,0), x_ := (— x)+ = — min(x,0). Let U,Ui,... be an IID sequence sam- 
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pled from a U[0, 1] distribution. For / G [0, 1] and n G let 

Cn+i{f) := E l[o,/](t^,), 

that is, C„+i(/) represents the number of members of population born at time n + 1 and 
whose fitness does not exceed /. As in the construction of X, wc let 

Lo(/) := 0, L„+i(/) := L„(/) + max(C„+i(/) - {In+i)-, -Ln(/))- (1) 

Since Cn+i{f) and arc independent of Lq, . . . , Ln, it follows that for each fixed /, 

L{f ) is a Z+-valued Markov chain. Note that -L„(l) = X„. 

We now provide an alternative construction which will be frequently utilized in the 
proofs. For / G [0, 1], let S{f) := {Sn{f) '■ n G Z+) denote the process consisting of the 
partial sums of IID random variables : 

SnU) ■■= E - (^i)-) = E l[0-/](^i) - ^n,-, n G Z+. 

0<j<n 0<j<5„,+ 

We also define the corresponding sequence of running minima, 

Mo(/) := 0, M„+i(/) = min(M„(/),5n+i(/)), n G Z+. 

The following identity is well-known, and we provide a proof only for convenience : 

Lemma 1. For all f G [0, 1] and n G 1+, Ln{f) = Sn{f) - M^if) 

Thus, the family of processes {L{f) : / G [0, 1]) consists of coupled reflected random 
walks. 

Proof. The claim is clearly true for n = 0. We continue by induction, 

Ln+l{f) = Snif) - Mnif) - min(- (C„+i (/) - {In+l)-),Snif) " M„(/)) 

= Snif) - min(-(Cn+i(/) - (/n+l)-) + M„(/),5„(/)) 

= Snif) + (Cn+l(/) - {In+l)-) ' min(M„(/), + Cn+l{f) - {In+l)-) 

= Sn+lU)-Mn+l{f). 

□ 

Since we are interested in scaling limit for the empirical distribution function of the 
fitnesses, we wish to work under assumptions that guarantee lim^^oo-'^n = oo a.s. This is 
why we make the following assumption : 

EI_ < EI+ < DO. (2) 
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Under assumption ([2]) we define a critical threshold for the fitness, fc 



We will focus on behavior of the ecosystem, restricted to the fitness interval [fc, 1], where 
a central limit theorem holds. As is not hard to show, for every / < fc, L{f) is positive 
recurrent and converges to its invariant distribution without centering and scaling. 



To present our results, we define the empirical distribution function Fn, 

Fnif) :-- 



X„>0 
0; otherwise. 



We also let F denote the distribution function of the U[fc, 1] law. That is, 

j^ff, (min(/, 1) - fc)+ 

= T^c ' 

and let 

A„ := Fn - F. 

Our first result is an analog to the Glivenko-Cantelli Theorem. 
Theorem 1. Assume condition Then 

lim ||A„||oo = 0, a.s. 

n— >oo 

This result follows directly from the work of Michael and Volkov and is equivalent to 
|MV1H Theorem 4-(b)]. The result in [MVllj is stated in terms of coupling between the 
ecosystem and an IID sample drawn from a U[fc, 1] distribution. We provide an alternative 
proof based on the Glivenko-Cantelli Theorem and the law of large numbers. 



We turn to the Functional Central Limit Theorem. For the remainder of the section 
we impose the moment condition 

E{l'^) < oo. (3) 

We first introduce the processes which appear in the statement of our result. Let Wi,W2 
be independent copies of standard Brownian motion, and let Bri denote the Brownian 
bridge associated with Wi. That is, 

Bri(/) ■.= Wi{f)-fWi{l), /G [0,1]. 
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We also define the process Wi on [0, 1] as follows. When /c = (equivalently, EI^ = 0), 
we let Wi = 0. Otherwise, let U ~ U[0, 1] be independent of Wi and W2. For t £ [0, 1), 
let At := ([0, t] + U) mod 1, and let At := /c + (1 - fc)At. Define 



^oo(t) := diWi{t) + cT2H^2(t), t G [0, 1]. 



V/c(l - fc) 

and 
where 



ai := V/cll - /c)i?/+, and ^2 := a(/e/+ - /-) = + VcEI+EI^ + 

and where here and henceforth, cf{Z) denotes the standard deviation of the square inte- 
grable random variable Z. We record the following. 

Lemma 2. Assume that conditions ([2]), ([3]) hold, and that fc > 0. Then Wi is standard 
Brownian motion on [0, 1]. 

Proof. Observe that \At\ = t{l — fc), independently of U, and that Ag C At s < t. As 
an immediate consequence, the finite-dimensional distributions of Wi conditioned on U 
coincide with those of Wi, and since Wi is a continuous processes, the result follows. □ 

For a compact interval /, we denote by D{I) the Skorohod space of real- valued cadlag 
functions on the compact interval /, equipped with the Ji-topology. Let ^ : -D([0, 1]) — )• M 
be the function 

^(x) := x(l) - inf x(t). 

0<t<l 

Here is our main result. 

Theorem 2. Assume that Q and ([3]) hold. Then for any /q G {fc, 1] we have 
{An\if,,i],FMc)) (VEI^Bn + (1 - F)a2W2{l),^{Y^ 



inD{[fo,l]) X 



Remark 1. The construction of the Skorohod space D([0, 00)), given for example in \Bil99[ 
Section 16, p. 166-179] could he repeated mutatis mutandi to obtain the Skorohod space 
D{{fc,l]). This results in a complete separable metric space, with the property that weak 
convergence is characterized by convergence of the restriction to L'([/o,l]) for every fo E 
ifd]. 
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For an explicit formula for the one-dimensional marginals, let 



9{f) := ^^fi^ - f)EU + (^) {fmil) + VcEUEI.+E{P_)). 

and let Z denote a standard normal random variable. Then in terms of the marginals, the 
theorem states that 

V^A„(/) ^ g{f) 

where the limiting distribution for f = fc is due to the well-known identity ^'(VFi) = 
\Wi{l)\, (e.g. |Kal02l Corollary 2.23]). Since for every / G [0,/^), L{f) is positive re- 
current, and / — )• Ln{f) is a nonnegative nondecreasing function, it easily follows that 
(^IjQj^j : n G N) converges uniformly on compacts to in probability and then, the same 

holds for {^/nAn\[oJ^) '■ n G N+). In light of the above, the sequence of right-continuous pro- 
cesses {^/nAn{•) : n G N) converges in some appropriate sense to a process on [0, 1] which 
is identically on [0, /c), is nondegenerate half- normal at fc, and a continuous Gaussian 
process on (/c, 1], whose right limit at fc is nondegenerate. In particular, the sequence is 
not-tight in -D([0, 1]), and neither is its restriction to D{[fc, 1]). 

Note that if we relax ([2]) and allow EI-. = EIj^, then the "scalable" fitness interval 
[/c, 1] reduces to a point {1}, because for any / < 1, L{f) is positive recurrent. It follows 
from the definition of F^, that Fn{l) is the indicator of the event {Xn > 0}. However, when 
EI- = EI^ < oo, this event occurs infinitely often, a.s. However, X„ = 5^(1) — 
and = X^o<i<n ^j' follows from Donsker's theorem that when = EI^ and 

E{I^) < oo, Xn/V^ ^ia{I)Wi). 

We comment that if D is any distribution function, we may consider the ecosystem 
obtained as above but with fitnesses sampled from the distribution D rather than the 
U[0, 1] distribution. If D has atoms then a.s. multiple elements with the same fitness 
will exist, and therefore we impose the additional condition that when when population 
size decreases the least fit elements are removed, and in case there are more elements with 
identical fitness than we need to remove, we choose those to be removed by the index of the 
random variable which determined their fitness, in increasing order. It is easy to see that 
the number of elements with fitness not exceeding / at time n is then given by L„ (!)(/)) 
reducing the analysis to the uniform fitness model above. 

As a final remark, we observe that the ecosystem has an interpretation as an urn system. 
Let /X be a probability on the subsets of N, and suppose that we have a system of urns 
labeled by N (only urns in the support of n will play a role here). We begin with all urns 
empty at time 0. Then at each time n G N, we add /„ balls to the system if > or 
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attempt to remove balls from the system otherwise. If /„ > 0, we add /„ balls, with each 
ball placed in urn k with probability independently of the others. If /„ < 0, then 

we remove the minimum between the number of the balls in the system and \In\) starting 
from urn 1, in increasing order, and ignoring empty urns. The combined number of balls 
in urns 1, . . . , at time n, is then given by . . . , k})). 

2 Proofs 

2.1 Proof of Theorem [1] 

Lemma 3. Assume condition ([2]). If EIj^ < oo, then 

1. lim„^oo Ln{f)/n = (/ - fc)+EI+, a.s. 

2. lim„^oo M„(/)/n = -(/ - fc)-EI+, a.s. 

Proof. Observe that ESn{f) = fEI^ — EI^ = (/ — fc)EI+. Thus, Sn{f) is transient to 
+00 if / > /c, null recurrent \i f = fc and transient to — oo if / < /c. In particular, 
inf„gN -^^n(/) > — oo a.s. or = — oo a.s. according to whether / > /c or / < fc- Since 
by Lemma [H Ln{f) = Snif) — Mn{f), it follows from the Law of Large Numbers that for 
/ > fc, 

lim L„(/)/n = (/ - fc)EI+, a.s. 

n— >-oo 

But since Ln{-) is nonnegative and monotone, it then follows that Ln{f)/n — )• a.s. for all 

/</c. 

As a result, for f < fc, 

lim M„(/)/n = lim S„(/)/n = (/ - fc)EI+, a.s., 

n— >oo n— >oo 

completing the proof. □ 

Proof of TheoremUi It follows from Lemma[3]-(1) that lim„^oo -^n = oo a-S- In particular, 

by taking n large enough we may assume X„ > 0. Let let Qk{f) '■= — — ^ . 

Then 

1 



Fnif) = ^ [Sn,+QS„,M) + fSn,+ " ^n,- " M„(/)j , 



and we have 



A ('^^ A, , r\ , fcSn,+ Sn- , J. r \Sn,+ (/ fc)+ Mn{f) 

^n[J) = -^Qs„,+ [J) H V ^ (/ - /cj-r; 7 Y — 

~ Jc 

^(f f^f^^'+ 1 ^ (/ - fc)- MM) ... 
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Since Sn,+ — )• oo a.s., it follows from the Glivenko-Cantelli Theorem that liiain^oo ^'^Pfe[o,i] \Qsn,+ {f)\ 
0. Assume now that EI^ < oo. Then by Lemma El liuin-^oo Xn/n = (1 — fc)EI^, a.s. It 
then follows from the Law of Large Numbers that 

lim — '— = and lim ■ — = 0, a.s. 

n->oo Xn I - Jc Xn 

In addition, supjg[j^ |M„(/)| < \Mn{fc)\, and by Lemma [3]-(2), lim„_^oo \Mn{fc)\/n = 

a.s. Thus it follows from ^ that lim„_!.oo supjgjj^ ^ |A„(/)| = 0, a.s. Next, observe that 

since -F|[o,/,] = 0, supjg[ojj |A„(/)| = supjg^jj Ln{f)/Xn = Ln{fc)/Xn. But by Lemma 
[3l-(l), lim„,_j.oo Ln{fc)/Xn = 0, a.s. This completes the proof for the case £'/+ < oo. 

We now assume EI^ = oo. Here fc = and we may rewrite ([5]) as 
Since EI^ < oo = EI^, we have lim„_!.oo Sn-/Xn = a.s., and 



Therefore lim„^oo = 1 a.s. Finally, supyg^^i] |M„(/)| = |M„(0)| = Sn-- Thus, 
lim„_^oo supjg[o,i] \^n{f)\ = 0, a.s. □ 

2.2 Proof of Theorem El 

We first wish to explain the problem and how one can solve it. Consider ([5]) from the 
proof of Theorem [1] above. Multiplying both sides by ^/n, it follows from the Glivenko- 
Cantelli theorem that the first term on the right-hand side converges to a Brownian Bridge 
multiplied by some constant, and it is not hard to show that jointly, the sum of the 
second and third term converges to an independent standard normal random variable 
multiplied by an affine function. The fourth term vanishes on [/c, 1], and the last term, 
xSjn converges uniformly to on [/q, 1] for every /q G (/c, 1]. This 
argument leads to a proof of the convergence claim for the first component in Theorem 
El T/nA„|[jg 1] . However, the joint convergence statement in the theorem requires more. 
This is because at /c the fifth term depends on the past, {Sk{f) : k < n), and scales to 
a nondegenerate random variable. In order to take this into account we will consider the 
centered processes {Sn{f) '■ f G (/c, 1]) and {S[nt]{fc) ■ t £ [0, 1]), where 

Snif) ■■= Snif) - ESnif) = Snif) " (/ " fc)nEU. 
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We will prove that the pair of processes scales jointly to some limiting process in the prod- 
uct space. We will then express \/raA„ as a function of the pair and apply the convergence 
result to deduce the theorem. The core of our proof is identifying the covariance structure 
of the limit process in the product space, not the actual convergence. In fact, the methods 
of Bickel and Wichura |BW71j allow to prove convergence of the two-parameter process 

: {t, /) G [0, but this is not needed in our work. 



We begin with a simple tightness statement. 
Lemma 4. For any Jq G [0, 1], the laws of (^|[/o,i] : n G N) in D{[fo, 1]) are tight. 



Proof. Let Qkif) '■= — . Then by the Central Limit Theorem for empirical 

processes, [Bil99l Theorem 14.3], Qk Bri in D[0,1]. Let T : D{[0,1]) D{[fo,l]) 
denote the restriction mapping Tx = Note that T is not continuous, but T is 

measurable. Since Bri is a continuous process, it follows from the Mapping Theorem 
|Bil99l Theorem 2.7] that (5fc|[/o,i] =^ Bri|[jg i] in D([/o,l]). In particular, the restricted 
processes {Qk\[fo,i] ■ k e N) are tight in D{[fo,l]). For A C D{[fo,l]) and c G M, let 
cA := {cx : x G A}. If A is compact and / C M is compact, then Aj := Uc^icA is compact 
in Z)([/o,l]). Indeed, if (c„x„ : n G N) is Siny sGC[UGncG in -A/, such, that Cn — )• c in / and 
x„ — 7- X in -D([/o, 1]), then for any sequence (A„ : n G N) of homeomorphisms of [/o, 1] onto 
[/o, 1] satisfying 

||A„(t) - t||oo 0, \\Xn - X o A„||oo 0, 

we have 

II Cji^n (cx) O A'^ ||oo ^ I Cn c| \ \Xn \ \oq ~\~ \c\ \ \Xn X O A^j || oo ^ 0. 

Thus, every sequence in Aj has a subsequence converging in D([/o, 1]) to a limit in Aj. 

/■S„,+-S„,--(/-/c)n£;j+ 



Let Rnif) ■■= ■"^"■+ ''^^ Jc)nr.,+ ^ ^^^^ ^^^^ ^^^^ (i?n|[/o,i] : ^ G N) as 

-)-(' 



processes in C([/o, 1]) are tight. Indeed, P(|i?„(/o)| > a) = p{ \UoSn,+-Sr.,-)-{h-fc)nEi+\ ^ 



a), therefore it follows from the Central Limit Theorem that 

lim lim P(|ii„(/o)| >a) = 0. (6) 

a— ^-oo n— >oo 

Furthermore 

P( sup \Rn{f) - Rniif + n) A 1)1 > 6) < p(M!h±_!^ > e), 
/6[/o,l],«<<5 

and again the by the Central Limit Theorem, 

lim lim P( sup \Rn{f)-Rn{{f + u)Al)\>e) = 0. (7) 
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By |Bil99l Theorem 7.3], ([6|) and ([7]) guarantee that the laws of {Rn\[fg^i] : n G N) are tight 
in C([/o, 1]). Observe that 

Sn I D 

\ n 

In order to simplify notation, in the remainder of the proof we abbreviate Qn\[fo,i]j -^n,|[/o,i] 
and 'S'n|[/o,i] to Qn, Rn and 5„. Fix e > and let Ki C -D([/o, 1]) and K2 C C([/o, 1]) be 
compact sets such that for all n G N, 

PiQn eKi)>l-e, P{Rn G K2) > 1 - e. 

Let I := ^/E^[l - e, 1 + e]. By the Law of Large Numbers, P{\[^ G /) > (1 - e) for 
all n large enough, hence 

P{fy G \l^K, + K,) < P& G (K,), + K2) + e. 
^/n V n ^/n 

But, 

^ fc=o 

00 

> 5^P(Qfc G i^l,i2n G i^2|5n,+ = k)P{Sn,+ = k) 
k=0 

00 

= Yl ^(Qk G i^i)P(iin G K2, Sn,+ = k)>{l-ef>l- 2e. 

Therefore, for all n large enoug G + 1^2) > 1 — 3e. It remains to prove that 

{Ki)i + K2 is compact in D([/o, !])• Let {xn + Un : re G N) be a sequence in {Ki)j + K2 with 
the property rc„ — )• a; in -D([/o, 1]) and Un ^ y C{[fo, 1]). Furthermore, let (A^ : n G N) 
be a sequence of homeomorphisms from [/o, 1] onto [/q, 1] such that 

||An(t) - t||oo and || 

Then 

+ l|yn — ylloo + \\v — V ° Aniloo — ^ 0, 

because y is uniformly continuous. Hence any sequence in {Ki)i + K2 has a subsequence 
which converges in Z)([/o, 1]) to a limit in {Ki)i + K2. 

□ 

Next we wish to express the Brownian motion W2 in terms of two other Brownian 
motions, and define an auxiliary process X^o- The following is well known. 



10 



Lemma 5. Let A, B two nonnegative square integrable random variables satisfying AB = 0, 
a.s. Then a{A)a{B) > {EA){EB). 

Proof. The inequality trivially holds if EA = or EB = 0. Therefore we will assume that 
the right-hand side is strictly positive. Dividing the inequality by (EA)(EB), we obtain 
the equivalent inequality : a{A/ EA)a{B / EB) > 1. Therefore there is no loss of generality 
assuming EA = EB = 1. Finally, from Cauchy-Schwarz, 

1 = E{A - 1)(1 -B)< a{A)a{B), 

and the claim follows. □ 

As a special case, letting A := /_|_ and B := /_, we obtain 

> E{I+)E{I^), 

and therefore define p G [0, 1] by letting 

lO otherwise. 

Let W2 and W2 be independent copies of standard Brownian motion independent of Wi, 

and define 

W3 := pW2 + - P^W^. 

If fc = 0, we let W2 := W2. Otherwise, (72 > and we let 

W2 := - (/c(t(/+)W^2 + <I-)W^) ■ 
cr2 

We observe that when /, /' G [0, 1] and 0<s<t<l, we have 

E {{fa{I+)W!2{s) + a{I^)W^{s)){f'a{I+)W!2{t) + a{I.)Wm) (8) 
= s {ff'a\U) + + (/ + 

= s {ff'cT\l+) + a\l.) + (/ + f')EI+EI_) . 

When f = f = fc and s = t, the right-hand side is equal to o"!. Therefore W2 is indeed a 
standard Brownian motion. We also let 



Xoo(/) := VeU Bri(/) + fa{I+)W^{l) + a{I^)W^il), f € [0, 1]. 
Lemma 6. Let < s < t < 1 and </</'< 1. Then we have 

1. E (Xoo(/)Xoo(/')) = /(I - f')EI+ + + a^{I_) + (/ + f)EI+EI^. 
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2. E{Y^is)Y^it))=sEiXM?)- 

3. E{X^{f)Y^{t))=tE{XMXoo{fc)). 

Proof. The first assertion is a consequence of dH). The second fohows from the definition 
of Yoo and the first. We prove the third. The left-hand side is equal to 



V/c(l - fc)EI+E(BnU)Wi{t)]+E {{fa{I+)W:,{l) + a{I-)W!,{l)) {f,a{I+)W!,{t) + a{I-)W'^{t))). 



(*) (**) 

By (ED, 

(**) = t {ffca\l+) + a\l-) + (/ + fc)EI+EI^) . 
To compute (*), write Bri(/) as a sum of three independent random variables, 

Bri(/) = (1 - f)W,{f) - f{W,{l) - W,{f)) 

= (1 - /)T^i(/e) + (1 - f){Wi{f) - W,{f,)) - f{W{l) - W{f)), 

We then have 

V/e(l-/e)i^(Bri(/)T^i(t)) =Eiil - fc)WiiU)a - f)Wi{f,)) 

+ E(f,[ l^^{s)dWi{s) X {I - f){Wi{f) -Wiifc))] 
\ AfcJ] J 

- E [fcj^^^^ l^Ss)dW^{s) X f{W{l) - 

= (1 - - f)U + - f)E\At n [/e, /]| - fcfE\At n [/, 1]| 

= (1 - - f)U + Ul -f){f- fc)t - fcfil - f)t 

= /,(l-/)t(l-/,-(/-/e) + /) 
= /c(l - f)t. 

Consequently, 

(*) = - f)t, 

and the claim then follows from the first assertion. □ 
Let Yn := {Yn{t) : t G [0,1]) be the process defined through Yn{t) := S^nt\{fc) = 

Slnt\{fc)- 

Lemma 7. The finite dimensional distributions of -^{Sn\(f^^i],Yn) converge to those of 
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Proof. Fix NeN. Let /i, . . . , /iv G (/c, 1], =: to < < • - < iiv = 1 _and 0i, . . . ,eN,m, ■ ■ ■ ,m ^ 
R. Forn e N, / G [/c, 1] and / = 1, . . . , AT, let A„,i(/) := ^^^t^j (/) - ^l^^^.^j (/). Observe 

that Sn{fk) = Z^ili ^n,l{fk), and that the (function-valued) "increments" A„^i(-), . . . , A„^7v(-) 
are independent. Let 



N 



1=1 k=l 

N N N 



Z=l Z=l fc=l 

Let Z{f) := (Eo<,</+ l[o,/](^i)) -/--(/- fc)EI+. Observe that = and 

Eisu^f < oo. Let V := {Z{fc), Z(fi), Z{fN)). To simplify notation, we will 

refer to the j-th entry of V as V{j — 1). For example, first entry, Z{fc), is V{0), and last, 
AT + 1-th entry Z{f^), is V{N). Let (V^ : A; G N) be an IID sequence of copies of the 
random vector V. We have 

{An,i{fc),An,i{h),...,An,i{fN))= J2 

0<j<si 

where si := [nti\ — [nf;_ij . Due to the independence of the increments A„^i(-), . . . , A„^jv(') 
and their above representations as partial sums of IID sequences with finite second moment. 
Letting := (^q, . . . , ^jy), where := r]i and 9j := rjj for j = 1, . . . , A^, we obtain : 

N 

1=1 

N 

4«((«e*--)"). 

1=1 

Since E{{6'' ■ F)^) < oo and lim;_^oo ^i/l = ti — ti^i, it follows that 

n—^oo \ J 

Therefore to prove the lemma we need to show that 

N / N ^ \ 

Yiti - ti-,)E{{e' ■ Vf) = E (Y^miYooiti) - Foo(ti-i)) +^^,-^oo(/,))' . (9) 

1=1 \ 1=1 j=l J 
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For any < j < k < N and taking /o := fc, 

EiVij)Vik)) = El{ l[oj^0i)-I--{fj-fc)EI+){ J2 l[0Mm-I--ifk-fc)EI+) 

\ 0<1<I+ 0<1<I+ 

= E\{ E MoMUi)){ E MoMm)]+Eiii)-if,-m,-mEi, 

\ 0</</+ 0<Z</+ / 

= f,EI+ + E{ll - I+)fjfk + E{ll) - ifj - QUk - fc){EI+f 
= fj{l - fk)EI+ + fjfk<y\l+) + E{I^_) - fl{EUf + Ufj + fk){EI+f 

= fj{i - fk)El+ + fjfk<y\i+) + <y\i-) + ifj + fk)El+El_ 

= E{X^{fj)X^{fk)). 

Thus, 

TV N 

Y,iti - ti-i)E [{6' . Vf) = J2 Vfiti - ti^i)E (Xoo(/c)') 
1=1 1=1 

N 

+ 2 ViOjiti - ti.i)E (Xoo(/c)^Oo(/i)) 

l,j=l 

I ^ 

+ E\C£^e,xufi)f 

By Lemma[6]-(3), the first line on the right-hand side is equal to "^iLi Tli{ti—ti~i)E {{Yoo{ti) — Yooiti-i))"^) ■ 
By Lemma [6l- (2), the second hue is equal to '2.J2i^j=i'ni^jE {{Yoo{ti) - >^oo(i/-i))-'^oo(/j))- 
Hence, ^ follows. ' □ 

We need the following technical lemma, whose proof is left to the appendix. 

Lemma 8. Let — oo < aj < bj < oo, j = 1,2 and let {Dj,T)j) denote the measure spaces 
given by -D([oj, bj\) equipped with the Borel a -algebra. Suppose that P,Pi,... is a sequence 
of (Borel) probability measures on {Di x D2,'Di x D2), satisfying 

1. {Pn : n G N) is tight. 

2. For any G N and fi,...,fN £ [o-i,bi]^, ti,...,tjv S [a2i&2]^ the distribution 
of the marginal . . . , x(/Ar)) , . . . , y(tAr))^ under Pn converges to its 
distribution under P. 

Then Pn^ P- 
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We are ready to prove the main theorem. 
Proof of TheoremlE Recall that = ^"(/)-^^"(/) . Therefore on [fc, 1] 



Sn{f)+n{f-fc)EI+ f-f, MM) 



1 — fc X,, 



n 



Sn{f) ^^^_^^^( EI+ 1 A M„(/) 



An(/) 



Xn \Xn/n 1 — fcJ Xn 

Since 

Eh 1 A / - /c n (1 - fc)nEI+ - X„ 



(/ - fc) 



Xn/n I - fcj I - fcXn n 

fc-fn (Sn{l) + Mn{l) 



1- fcXn \ n 

We can write _ _ 

VnAnif) = — + + EM), 

Xn\ ^/n I - fc V'n J 

where 

P .r, n ffc-fMM) MM) 

En[f) ■■= -77- 



Xn\l-fc\/n ^/n 
Fix/oG Then, 

sup \EM)\ < ^ ^ a-s- 

/e[/o,i] yjn 

As for f = fc, observe that 

(Snifc) - Mn{fc))/V^ {Yn{l) " inft<i Yn{t))/V^ "^(Yn/V^) 



VnFnifc) 

Let T : D{[fo,l]) D{[fo,l]) be the measurable mapping (Tx)(/) := x{f) + ^x{l). 
Then we have 



Xn/n Xn/n Xn/n 



V;j(A..I,/„a,.^.(/.)) = (|;n|) + E...|;*(^)). 

By Lemma m the laws of Sn\[fQ^i]/ ^/n are tight in D([/o, 1]). By the Invariance Principle 
|Bil99l Theorem 14.1], the laws of Yn/\fn are tight in D([0, 1]). Therefore the laws of 
■^(5„|[j,j 1], y^) are tight in the product space D([/o,l]) x L'([0, 1]). Since by Lemma [7] 
the finite dimensional distributions converge to those of (Xqo, ^oo)) we obtain from Lemma 
El that 

1 _ 

■wn 
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in -D([/o, 1]) X D([0, 1]). In addition, since X^c and Yoo are continuous processes, it follows 
from the Mapping Theorem |Bil99[ Theorem 2.7] that ^(:^)) {T{Xoo),'^iYoo)) 

inL»([/o,l])xL»([0,l]). In addition, L„/n {l-fc)E{I+) a.s. and supjgjj^,^!] |£^n(/)| ^ 0, 
a.s., therefore if we denote (r(-^), ^'(-^)) hy An, the corresponding weak limit (r(Xoo), ^(yoo)) 
by ^oo and denote {n/Xn, En) by Bn and it corresponding a.s. limit ( (^i-/)ei^ ' Q) '^oo' 
then for any uniformly continuous G : (D([/o, 1]) x D([0, 1])) x — )• M, we have 

EG{An ,Bn)-EG{Aoo,Boo) = E {G{An,Bn) - G{An,Boo))+EG{An,Boo)- EG{Aoo ,Boo). 

Since G is uniformly continuous and Bn Boo, a.s., it follows that E {G{An,Bn) — G{An,Boo)) — ) 

0. Since Boo = { (i-fl)EI+ ' 0)' =^ -^oc '^^ '^^^^ t'^^* EG{An, Boo) - EG{Aoo, Boo) 

0. Hence, (^oo,^oo) in (L>([/o,l]) x D{[0,1])) x M^. By Skorohod's represen- 

tation theorem [Bil99[ Theorem 6.7], that there exists a probability space and random 

elements on it, A'n := B'n := {n/X'^,E'^) such that {A'n,B'n) = (A,i3„) and 

lim„^oo(A,^n) exists a.s. in (D([/o,l]) x D([0,1])) x M^. Therefore, if G : D{[fo,l] x 
D{[0, 1]) ^ M is continuous and bounded, it follows from the bounded convergence theorem 
that 



71— >00 



Finally, 



= /Ei+Bri(/) + (/ + ^£_±)a(/+)iy^(l) + (1 + ^f_^)a(/_)iy^(l) 
= v^Bri(/) + (1 - F)(/)(72iy2(l), 
completing the proof. □ 



Appendix 

Proof of Lemma 0. Since Z?i and D2 are complete and separable, so is Di x 1)2 • In addition, 
by assumption (P„ : n G N) is tight, therefore it follows from Prohorov's Theorem that 
{Pn : n € N) is relatively compact. In particular, in order to complete the proof it is enough 
to show that whenever Pn^,Pn2, ■ ■ ■ is a convergent subsequence, say to Q, then P = Q. 
Suppose we have such a sequence. For s E [aj,bj], let Jj{s) = {z £ Dj : z{s-) / z{s)}. 
Also let TTj : Di X D2 ^ Dj be the (continuous) coordinate mappings, defined through 
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7ri(x,y) := x and 7r2{x,y) := y. Since Q o ttJ is a Borel probability measure on Dj is 
follows (e.g. |Bil991 p. 138]) that there exists a countable set, Rj C {aj,bj), such that 
Q o TTj^{Jj{s)) > if and only if s G Rj. Let := [aj,bj]\Rj. Let G N and choose 

7 G Ji^ and t G ^2^- For v := {vi, . . . , wjv) G (Jj)'^ let /ij-u : L>j be the function 

h(z) := {z(vi), . . . , z{vi\f)). Then h^j is continuous Q o 7rj~"'^-a.s. and /i2f is continuous 
Qo 7r2"^-a.s. As a result, the function /ijj : x — ^ x I^^i which is defined through 
hjj{x,y) := {h^j{x),h2 j{y)) is Q-a.s. continuous. Therefore it follows from the Mapping 
Theorem |Bil99l Theorem 2.7], that 

Qoh^l = Po hz], if 7 G Ji^ and t G Js^- (10) 

Let 

■Pj := {hl^{E) : v G Jj^for some G N, C is a Borel set}, j = 1, 2. 

Then "Pj is a H-system. In addition, it follows from |Bil991 Theorem 12.5-(iii)], that criVj) = 
Vj. Let V := {A X B £ Vi X 1)2 : A £ Vi, B € ^2}- Then V is again a B-system, and it is 
easy to see that o"(P) = Pi x Furthermore, pOj) guarantees that P and Q coincide on 
V. It follows from the H — A theorem that Q = P. □ 
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